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Over 30 years of experience in the simulation, modeling and analysis of man-machine control 
systems has resulted in a variety of rules-of-thumb and some quantitative criteria for assuring valid 
simulation of “real-world” situations and likely users. It is hoped that these criteria, which apply 
directly to teleoperations (i.e., no communication delays; operator-in-the-loop; no “smart-robot del- 
egation), will be useful for designing better telerobots and in simulating telerobotic controls and vir- 
tual environments. 

First, some definitions are given: “Valid simulation” is defined as that producing the same opera- 
tor behavior, performance and mental workload as the real-world case. “Delay artifact” is the 
(measured) sum of all throughput delays from: sensing, computing, pipeline and display generation. 
“Kinetosis” is the vertigo and malaise from conflicts among visual, vestibular and proprioceptive 
motion cues. “Mental workload” is the operator’s evaluation of his attentional-load margin while 
performing adequately in a specified task context. 

A review is given of a wide range of simulations in which operator steering control of a vehicle 
is involved and the: dominant-cues, closed-loop bandwidth, measured operator effective time-delay, 
and ratio of bandwidth-to-inverse delay, are summarized. For well designed and low mental work- 
load conditions, this ratio is well under 1 .0, as control theory would dictate. However, for important 
human tasks like fast locomotion, the ratio approaches 1 .0 (limited by the inverse delay limit of 
about 8 rad/sec), and the mental workload becomes critical. These imply requirements that the eye- 
ball stabilization and pursuit subsystems have higher bandwidth. More importantly, it dictates that 
any simulation delay artifact must be less than about 1/4 of the effective operator delay in a given 
task, i.e., less than about .04 seconds delay artifact for locomotion simulation. 

A correlation of kinetosis (simulator-sickness) with dynamic scene field-of-view (FOV) is 
shown. It has been found that, to avoid kinetosis, the FOV should span less lateral view than a curve 
of about 1.10 Gy would cover at real-world speeds (typically, less than 60 degrees). Other require- 
ments include: framing of scene “streamers” and avoidance of perceivable image jitter or “strobing.” 

The visual resolution of a virtual environment should allow reading a newspaper subheadlines at 
arms length. High Definition Television (HDTV) would pass this test. 

The use of moving base simulators to improve the validity of locomotion teleoperations is dis- 
cussed, and data are shown to support the following recommendations. Linear motion bases are not 
needed if the real-world task entails less than about 1.1 Gy of transverse acceleration. If the rms Gy 
is greater, it is more important to maintain correct motion-cue phasing (<30 degree disparity) than 
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amplitude, which can be cut to about 1/5 the actual levels. Rotary motion rates are sensed and used 
as “rotary motion dampers” when the real-world task is regulation against inertial motion distur- 
bances (as in running), but are ignored when the task involves pursuit of a maneuvering target. 
Details are discussed in the presentation. 

Some rules-of-thumb for good “feel-system” simulation, such as for control manipulanda are 
given. Their vernacular version dictates that “good” simulation of a: 

- zero inertia and force-free control should “feel like a stick of balsa wood” (negligible 
friction, jerk or jitter) 

- hard stop should “feel like a brick wall” (no creep or sponginess) 

- coulomb friction should “feel like sliding a refrigerator magnet” (remain in place; no creep, 
bounce or jitter) 

- centering detent should “yield an audible “klunk” when traversed” (no lag or sponginess) 

Try these on your favorite manipulandum! 

Finally, simulation tests of teleoperators and virtual environments should include three types of 
measures: system performance, operator (or robot) “behavior” (e.g., describing functions, etc.), and 
me ntal workload evaluations. The criteria for adequate mental workload measures are that they be. 


1. Relevant 

2. Sensitive 


3. Concordant 

4. Reliable 

5. Convenient 


to mental workload, per se 
monotonic correlation with workload 
insensitive to irrelevant variables 
high test power (covariance/residual) 
ubiquitous trends in target population 
proven test: retest repeatability 
proven norms and statistics 
easy to administer and learn 
portable 

low cost for adequate level of reliable result 


Properly designed subjective ratings usually fare better than such measures as evoked response 
potentials! Examples of the foregoing approach are given, in optimizing motion washouts. 


If your teleoperator or virtual environment simulation can pass these rule-of-thumb tests, then 
you can be fairly sure that it will provide results which can stand the final test of real-world valida- 
tion, form a proper data base for scientific modeling and engineering design, and be liked by its 
users. 
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CONTROL BW AND H.Q. DELAYS ARE RELATED 


SIMULATION 

(Example) 

DOMINANT CUES 

CLOSED-LOOP 
BANDWIDTH 
BW (r/s) 

TYPICAL 

OPERATOR DELAY 
r(sec) 

BW 

VISUAL 

MOTION 

FEEL 

r*> 

Ship Conning 
(SES-2000) 

D 

Disturb 

- 

.01- .10 

2-JS 

20 

Blimp mooring 
(S-500) 

D 

- 

- 

<3 

JS 

.15 

Manual Booster Control 
(Saturn V) 

D 

Disturb 

Disturb 

1J5 

3 

.45 

Transport Aircraft 
(Boeing 707) 

D 

Some 


2.0 

2S 

JS 

Fighter Aircraft 
(F-16) 

B 

V 

WM 

4.0+ 

.15— -.22 

B 

Automobiles 

(Honda) 

B 

J 

B 

4 .0+ 

35 

JS 

Bicycle (slow) 
(Recumbent Bike) 

B 


n 

€L0 

.15 

3 

Cursor Aiming 
(Critical Instability Task) 

B 

- 

- 


.12— .20 

1 JO 

Eye • Pursuit Loop 


- 

- 

10 

JOS 

& 

Eye - Vestibulo-ocuiar 

7 


7 

30+ 

JOB. 

.6 


IMPLICATIONS - VISUAL DELAYS 

• Optimized control tasks have BW/t" 1 « 1.0 

• Human will adapt r eff to * 1 /5 BW, down to t * 20 sec 

• For high BW tasks: BW/t - 1 » 1.0 and r min > .16 sec 

• Control theory shows that any simulation delay artifacts must be <xJ20 
sec to provide "valid" simulation 

Criterion 1 

• "Valid" simulation requires delay artifacts be « .20 sec: 

<.02 sec (60Hz) = Excellent; <.04 sec = Good; >.10 sec = Invalid 
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FIELD OF VIEW VS. KINETOSIS 

Fixed-Base Vertigo vs. Reid of View 


Frobobitily of Vertigo ( SNort -Term "Awareness*] 



implications: For wide FOV use "impoverished scene" 


Criterion 2: 


Keep FOV to cover less lateral view than a curve of ±.10 would 
cover at real-world speeds y 


Other factors: 

• More parafoveal details worse conflict 

• Proper framing of parafoveal streamers is important 


VISUAL UPDATE AND RESOLUTION OF DISPLAYS 


Criterion 

* For "inner loop* control of path rate and curvature, "streamers" from 
scene microtexture should not jerk or strobe backward. 

(« 20-60 frames/sec update) 


Criterion 

• For "outer loop" guidance and navigation must be able to perceive and 
understand cues at « 3-5 sec ahead of vehicle 
Implies = 2 min-arc of resolution for signs, potholes, targets (e.g., HDTV) 


Criterion 

• For Virtual Environment should be able to read a newspaper at arm's 
length. (Subheadlines = OK) (e.g., HDTV) 


45 



VERIFICATION OF VALID SIMULATION 
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